Body movement to sound interface with vector autoregressive hierarchical hidden Markov models

نویسندگان

  • Dimitrije Markovic
  • Borjana Valcic
  • Nebojsa Malesevic
چکیده

Interfacing a kinetic action of a person to an action of a machine system is an important research topic in many application areas. One of the key factors for intimate human-machine interaction is the ability of the control algorithm to detect and classify different user commands with shortest possible latency, thus making a highly correlated link between cause and effect. In our research, we focused on the task of mapping user kinematic actions into sound samples. The presented methodology relies on the wireless sensor nodes equipped with inertial measurement units and the real-time algorithm dedicated for early detection and classification of a variety of movements/gestures performed by a user. The core algorithm is based on the approximate Bayesian inference of Vector Autoregressive Hierarchical Hidden Markov Models (VARHHMM), where models database is derived from the set of motion gestures. The performance of the algorithm was compared with an online version of the K-nearest neighbours (KNN) algorithm, where we used offline expert based classification as the benchmark. In almost all of the evaluation metrics (e.g. confusion matrix, recall and precision scores) the VAR-HHMM algorithm outperformed KNN. Furthermore, the VAR-HHMM algorithm, in some cases, achieved faster movement onset detection compared with the offline standard. The proposed concept, although envisioned for movement-to-sound application, could be implemented in other human-machine interfaces.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An Empirical Study of Dynamic Bayesian User Modeling with Stochastic Processes

Six topologies of dynamic Bayesian Networks are evaluated for predicting the future user events: (1) Markov Chain of order 1, (2) Hidden Markov Model, (3) autoregressive Hidden Markov Model, (4) factorial Hidden Markov Model, (5) simple hierarchical Hidden Markov Model and (6) tree structured Hidden Markov Model. Goal of the investigation is to evaluate, which of these models has the best fit f...

متن کامل

Bayesian time series classification

This paper proposes an approach to classification of adjacent segments of a time series as being either of classes. We use a hierarchical model that consists of a feature extraction stage and a generative classifier which is built on top of these features. Such two stage approaches are often used in signal and image processing. The novel part of our work is that we link these stages probabilist...

متن کامل

Stock Returns and Real Growth: A Bayesian Nonparametric Approach

The study of the joint dynamic behavior between stock market returns and real economic growth rates is an important empirical question in finance and macroeconomics. This paper investigates their linkage by proposing a vector autoregressive infinite hidden Markov model. Our model has two advantages over the existing approaches in the literatures. In contrast to Markov switching models with fixe...

متن کامل

Nonlinear mixture autoregressive hidden Markov models for speech recognition

Gaussian mixture models are a very successful method for modeling the output distribution of a state in a hidden Markov model (HMM). However, this approach is limited by the assumption that the dynamics of speech features are linear and can be modeled with static features and their derivatives. In this paper, a nonlinear mixture autoregressive model is used to model state output distributions (...

متن کامل

Parameter estimation for non-Gaussian autoregressive processes

It is proposed to jointly estimate the parameters of nonGaussian autoregressive (AR) processes in a Bayesian context using the Gibbs sampler. Using the Markov chains produced by the sampler an approximation to the vector MAP estimator is implemented. The results reported here used AR(4) models driven by noise sequences where each sample is iid as a two component Gaussian sum mixture. The result...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/1610.08450  شماره 

صفحات  -

تاریخ انتشار 2016